Papers with controlled dataset Biography-Reasoning
Understanding New-Knowledge-Induced Factual Hallucinations in LLMs: Analysis and Interpretation (2026.findings-acl)
Copied to clipboard
| Challenge: | Prior studies have shown that fine-tuning on new knowledge can induce factual hallucinations in large language models (LLMs), leading to incorrect outputs when evaluated on previously known information. |
| Approach: | They propose to conduct a fine-grained analysis of large language models using a dataset Biography-Reasoning and QA and knowledge reasoning tasks to understand their findings. |
| Outcome: | The proposed model is able to perform a range of downstream tasks without requiring a large amount of knowledge and is compared with a control dataset. |